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ABSTRACT 



This thesis examines a proposed empirical method 
for determining the the 100(1-a)% lower confidence 
limit for the reliability of a system composed of a 
mixture of series and parallel connected components 
for which only component level test data is available. 
The method is an extension of the Log-gamma procedure 
originally proposed for series connected systems only. 
The accuracy of the method is assessed for some 
representative system reliability constructs using a 
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are examined with a view toward identification of 
accuracy indication parameters which may be estimated 
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I. INTRODUCTION 



Often, in the design and production of complex systems, 
an important question to be answered early in the process 
concerns the demonstrable system reliability based upon 
observed mission test results. Usually only components and 
minor subassemblies can be tested in any but the very latest 
stages of production. For reasons of prototype cost, the 
lack of complete systems for early tests, the expense 
involved in total system operational tests, and the need to 
make production decisions as early as feasible, reliance 
must be shifted to the component test results to provide at 
least an approximate answer to this question. Component 
data must be used in spite of the moderately strong 
assumptions needed to transform such test results into an 
estimate of overall system reliability. 

Since estimates are, by their nature, inexact, it would 
be reasonable to expect that the most credible estimate 
would be one which was both conservative and carried with it 
an indicator of the degree of conservatism associated with 
its computation. This, of course, is a description fitting 
a lower confidence limit when referring to estimates of 
system reliability. Thus, when one speaks of a "100(1-a)% 
lower confidence limit” and obtains a value for it, the 
assertion is that the obtained lower confidence limit value 
is less than the actual system reliability with probability 
1-a. 



In 1968, J. R. Borsting and W. M. Woods developed what 
is known as the Log-Gamma method for computing lower 
confidence limits for system reliability based upon 
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component mission test results only [Ref. 1], As originally 
developed, the Log-Gamma method was restricted to systems 
composed of all series connected components. It did, 
however, offer the advantage of allowing for unequal sample 
sizes, so the number of component tests could vary 
arbitrarily from component to component without degrading 
the procedure accuracy. In addition, no assumption is 
needed concerning the failure distribution of any component. 

Woods has recently proposed a modification to the 
procedure which, it was hoped, would extend its application 
to a mixed system of series and parallel connected 
components. The purpose of this study is to assess the 
accuracy of the revised procedure when applied to some 
typical component failure data from several representative 
series and series- parallel systems. An attempt is also made 
to discern parameters (constructed from or inherent to the 
sample data, component reliability goals, testing plan, and 
system design) which could provide useful indicators of the 
expected accuracy of the procedure. 
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II. THE PROC EDUR AL MODEL 



It should be noted that two rather strong assumptions 
need to be made with respect to system and component 
reliabilities. First, it must be assumed that component 
tests were conducted in a test environment not unlike that 
encountered in the system operational mission environment 
profile. Second, no component reliability degradation will 
result from interactions with other components when 
assembled into the system- The degree to which these two 
assumptions are met will have an unknown but potentially 
great effect upon the validity of the model and indeed upon 
the whole concept of system reliability prediction from 
component attributes data. 



A. DEVELOPMENT FOR SERIES SYSTEMS 



This section gives a modified and elaborated development 
of the basic reliability model and estimation procedure 
based upon that presented by Woods and Borsting [Ref. 1]. 

For a system of k components in logical series, the 
system reliability, Rs, can be expressed in terms of the 
individual component reliabilities as the product 

Rs = IT Pi (2. 1) 
i=1 

where Pi is the true reliability of the i-th component. 
From Pi the component unreliability, Qi, is defined as 
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Qi = 1-Pi. 



Taking the natural logarithm in equation (2. 1) and 
defining the new variable, S: 

k 

S = -InRs = - e ln(l-Qi) (2.2) 

i= 1 

The natural logarithm can be expanded by the infinite series 
In (1-X) = - E 

j=1 

S = E z (Qi? / j (2.3) 

1=1 g = 1 

k 

S = E [ Qi + Qi2/2 + Qi 3 /3 + ...] 
i= 1 

For Qi small, say 0.1 or less, the above series may be 
approximated by the first two terms with a maximum error of 
0.34% of the true value. Thus, 

k k 

S = E [Qi + Qi 2 /2 ] = E Ti (2.4) 

i=1 i=1 

where Ti = Qi + Qi 2 /2. For the remainder of the 

derivation this approximation is treated as an equality. 

Appendix A derives an unbiased estimator, Ti, for Ti: 

Ti = AiQi + Bi[ Qi 2 ]/2 (2.5) 

where Ai = [ 2Ni-3 ]/[ 2Ni-2 ] 

Bi = Ni/[ Ni- 1 ] 

Qi = Fi/Ni 

and, ^ Fi is the number of failures resulting from Ni 

mission tests conducted on the i-th component. 

An unbiased estimator of S will be obtained from 



(X 



hi 



for 0<X<1 
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k .. 
S = E T l 
i= 1 



( 2 . 6 ) 



S will be an unbiased estimator of S, since it is the sum of 
the unbiased estimators, Ti, of Ti. 

Appendix B shows that, for the reasonably expected range 
of values for Qi and Ni, the variance of S may be 
approximated 

Var[ S] = Z Var[ Ti ] ± e [ Ti/Ni ] (2.7) 

i= 1 i=1 



By intuitively assuming the probability distribution of 
S is of the gamma type with parameters r and 0, an 
expression can be derived for a confidence interval for Rs. 



) 



The gamma probability density may be written as 



f„(x,r,0) = 
S 



r-1 -x/0 
-x e 



p r x>0 

i(*)*e 



( 2 . 8 ) 



x<0 



with mean = r0 and variance = r0 2 . 



To determine the values of r and 0, the following 
relationships are established: 

E[ S ] = r0 from Eg. (2.8) 

k 

E[ § ] = E Ti from Eg. (2.4) 
i = 1 



Var[ S ] 
V a r[ S ] 



= r0 2 from Eg. (2.8) 
k Ti 
i= 1 Ni 

may be solved simultaneously to 



yield the 



1 1 



These eguations 



following expressions for r and 0: 



r = 



k 12 
Z Ti 
i=1 



k Ti 
Z — 
i=1 Hi 



and 0 = 



k Ti 
Z — 
i=1 Ni 

~k~ 

Z Ti 
i=1 



and an estimator, r, for r would be 




i=1 Ni 



(2.9) 



Note that for S distributed as gamma (r,0), 2S/0 will be 
distributed as chi-sguare with 2r degrees of freedom [Ref. 
2, p. 181]. The following probability statements can then 
be made: 




( 2 . 10 ) 



Since 0 = E[S]/r from Eg. (2.8) and E[S] = -InRs from 

Eg. (2.2), 



1 -a 



1 -a 



[-InRs 


2S 1 


1 r - *> 


J2 




X,2r,1-a J 



P InRs < 



-2rS 



^2r,1-ot ■ 



Thus the 100(1- a )% lower confidence limit, Rs*<a>, for Rs 
is 



Es*< a) 




( 2 . 11 ) 
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A 100 (1—ot )% lower confidence limit estimate, Rs*< a) , for Rs 
would be 



Rs*< a) 




( 2 . 12 ) 



The primary difficulty this formulation presents lies in 
the non-integer nature of values for 2r as defined. 
Although some computer routines are available to approximate 
chi-square values with non-integer degrees of freedom, most 
users would find such a requirement difficult to fulfill at 
least. Therefore 2r is replaced with the expression 
[ 2r ] = smallest integer > 2r 

This is justified by noting that the ratio of the chi-square 
value divided by its number of degrees of freedom varies 
slowly with changes in the degrees of freedom for values of 
degrees of freedom greater than about five. Further, since 
2c may be changed moderately, by up to 1.0, without great 
change in the ratio value, it is reasonable to expect that 

the probability distribution of [2rl/V „ has small 

' j\-l 2r ], 1-ct 

variance. This expression can be subsittuted into equation 



(2. 12) to yield 

R S *<a> = exp 






C 2r ], 1-a J 



(2. 13) 



Since the computer routines available for this research 
included the capability of computation of chi-square values 
with non-integer degrees of freedom, some simulation runs 
were performed using both equations (2.12) and (2.13) for 
comparison. The results indicated that the effects were 
limited to the third decimal place at worst and thus had 
little significance with respect to the procedural accuracy. 
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B. REVISION FOR SERIES-PARALLEL SYSTEM 



Proceding from the strictly series system procedure 
developed above, the principal revision for the mixed 
series-parallel system procedure was to redefine fi and r as 
follows: 



- Fi Fi 2 

; Ai — + Bi 

Ti = <f Ni 2Ni 2 

_ (1-Ri) + (1-Ri) 2 /2 



i=1,2,...,Kl 
i=Kl + 1 ,. . . , K2 



(2. 14) 



r 



max 



1 . 0 , 



'K1 + K2 „ 1 
Z Ti 
i= 1 



2 



K1+K2 Ti 
Z — 
i=1 Ni J 



(2. 15) 



K1+K2 . 

S = Z Ti (2. 16 

i= 1 



where Ai , Bi, Fi, and Ni are defined as before 
K1 is the number of series components 
K2 is the number of series-parallel subassemblies 
interconnected in series 

A 

Ri is the reliability point estimate for the i-th 
subassembly determined in the usual manner from the 
individual point estimates for the subassembly components as 
derived from the raw failure data. 



Although some comparison runs were made using Ai and Bi 
coefficients for the subassembly contribution to S, no 
significant improvement in accuracy was noted and the use of 
these coefficients in this manner was abandoned due to the 
difficulty of computation with varying sample sizes within a 
subassembly. 
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c. 



SPECIAL CIRCUMSTANCES 



In the event of no failures in any components or a lack 
of sufficient failures in subassembly components such that 
the basic procedure yields an S value of zero and, thus, a 
system reliability lower confidence limit estimate of one, 
an alternate approach must be employed. 

Statistically, the optimum solution might be to continue 
testing until sufficient component failures have been 
observed such that the above conditions no longer exist. 
However, such a solution might also not be economically 
feasible. Therefore, the sinulation included provision for 
an alternate procedure when S equals zero at the end of the 
programmed number of tests on all components. In addition, 
several cases were included where such conditions would be 
expected to exist in a significant number of the simulation 
runs, in order to observe the efficacy of the alternate 
procedure. 

The derivation of this alternate procedure is given in 
Appendix C. The procedure may be summarized as follows: 

(i) Find the series component or subassembly with the 
smallest actual or equivalent number of trials, N or N', 
respectively. (See section IV.B.1) 

(ii) Change the number of component or subassembly 
failures to F* by the following scheme: 



a 


F * 






0.2 


0.37 


NOTE: For best 


results, N or 


0 . 1 


0.25 


N’ should be at 


least 10. 


0.05 


0.16 
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If a subassembly was selected, treat the subassembly as a 
component with P* failures out of N* mission trials for the 
remainder of this procedure. 

(iii) Recompute the lower confidence limit estimate 
using the basic log-gamma procedure with the revised failure 
data. This estimate is approximately equivalent to a raised 
to the 1/N power as explained in Appendix C. 
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III. THE SIMULATION 



A. PROCEDURE 



l 

The computer simulation program is listed in Appendix P. 
The following procedure was incorporated into the program: 

Step One: Initialize and read in values for the total 
number of components in series, K1 , the number of 
subassemblies in series, K2, the number of components within 
each subassembly, the number of tests performed upon each 
component, Ni, the true reliability of each component, Ri, 
and the seed value for the random number generator. 

Step Two: For each component in turn, generate the 

observed number of failures as a binomially distributed 
random variable, Fi, with parameters Ni and (1-Ri) . 

Step Three: Compute Ti for each series component and 

A A A 

subassembly, S from the sum of the Ti, and r according to 
equations (2.14), (2.15), and (2.16) respectively. 

Step four: Compute the resulting estimate of the 

100(1- a) X lower confidence limit, R*< a) , according to 
equation (2.13) for representative values of alpha and store 
each estimate in a vector array of estimates. Alpha values 
used in this study were 0.20, 0.10, and 0.05. 

Step Five: Repeat Steps Two through Four until the 

three vector arrays of estimates corresponding to the three 
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different alpha values are 1000 values in length. 

Step Six: Order the elements of each vector array from 
low to high and determine the sample mean and standard 
deviation. 

Step Seven: Compute the true system reliability, Rs, 
from the input component reliabilities. 

Step Eight: Extract the 100 (1-a) percentile value from 
the corresponding array and compare with the true system 
reliability. If the estimation procedure is accurate these 
two values should agree. If agreement does not occur, the 
differences should be small, preferably conservative, and, 
hopefully, can be made to converge toward zero. 

Step Nine: Output all data which was input in Step One 
in order to insure against input error. Output starting and 
ending random number generator seed values. Output true 
system reliability, 100 (1-°) percentile values, differences 
from true reliability, sample means and standard deviations, 
and various percentile values of interest. Provision is 
made in the program for output of all of the sample values 
both before and after ordering, if the user desires. 

Step Four was perfnrmed in two different ways for four 
of the cases where there was a high frequency of runs 
without failures, called 'null runs' in the output. The 
normal way of handling this problem was to discard that run 
data and repeat it from step one. Thus the complete arrays 
contained estimates from only those runs which had 
sufficient failures for the procedure to be valid without 
the special circumstances modification discussed in Section 
II. C. In order to observe the effect of utilizing the 
modification, however, cases 18 through 21 were repeated as 
cases 30 through 33 with the alternate procedure invoiced 
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whenever S equalled zero at the end of step three. 

Three proprietary routines were utilized in the program 
and are therefore not reproduced in the program listing. 
These routines were used to obtain the binomially 
distributed random variables, the chi-square function 
values, and to sort the estimate arrays [Ref. 4]. 



B. DESCRIPTION OF THE CASES 



1 . Genera l 

The cases chosen for simulation represent three 
different configurations; a series of components connected 
in series with a series of simple series-parallel 
subassemblies of components, a strictly series-connected 
system of components, and a system which incorporates two 
somewhat unusual but representative "r eal-world" subassembly 
reliability relationships. The first configuration was 
chosen to demonstrate the general performance of the revised 
estimation procedure with a moderately complex, 
series-parallel system. The second configuration consisted 
primarily of some cases which had previously been 
investigated for the original Log-gamma procedure [Ref. 1 ]. 
Since the revised procedure varied somewhat from the 
originally developed version in the treatment of the wholly 
series system, a comparison was desirable in order to 
ascertain whether significant effects had occurred in the 
procedure accuracy. The third configuration was chosen to 
observe the robustness of the procedure when applied to a 
much more complex system which is not easily reducable to a 
simpler series-parallel reliability representation. 
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In general, the simulated number of tests was the 
same for each component within each case. However, this 
number was varied among cases with the same true system 
reliability in order to identify its effect upon the 
procedure accuracy. The two exceptions were case 13 wherein 
the number of tests varied from component to component and 
case 14 for which only one value of simulated component 
tests was used without any corresponding cases with 
different numbers of tests. 



2. Cases One Through Twelv e 



a. Reliability Block Diagram 



«- | 01 | -j~02~|- ••• 





b. Test Parameters 



(D Number of Component Test fli. 





Cases 




_Ni 




01, 


1 

o 

o 


10 


20 


i=1 ,2, . . . ,32 


02, 


05, 08, 


1 1 


50 


i=1 ,2,. ..,32 


* 

m 

o 


06, 09, 


12 


100 


i = 1 ,2 ,. . . ,32 



20 



and Ri 



(2) True System and Com£onen t Reli abilities , Rs 



Cases Rs 



01, 


02 , 


03 


.87559 


04, 


* 

in 

o 


06 


.79984 


07, 


o 

00 

* 


09 


.79167 


10, 


ii. 


12 


.72317 



Ri_ 






995 


i— 1,2,. 


.. ,20 


950 


i=2 1 , . . 


.,32 


995 


i=1 , 2, . 


.. ,20 


900 


i=2 i ,. . 


.,32 


990 


i= 1,2,. 


.. ,20 


950 


i=2 1 ,. . 


.,32 


990 


i=1 , 2, . 


.. ,20 


900 


i=2 1 , . . 


.,32 



3. Case T hirt een 

a. Reliability Block Diagram 




b. Test Parameters 



i 


_Ni 


_Ri_ 


_i 


•HI 

5Z.I 

1 


_Ri_ 


_i 


_Ni 


_Ri_ 


1 


150 


.995 


7 


28 


.967 


13 


59 


.682 


2 


90 


.985 


8 


125 


.995 


14 


5 


.729 


3 


75 


.979 


9 


63 


.970 


15 


5 


.729 


4 


100 


.988 


10 


125 


.995 


16 


5 


.729 


5 


125 


.982 


11 


59 


.682 


17 


19 


.536 


6 


18 


.980 


12 


59 


.682 


18 


19 


.536 


Rs: 


0. 


72329 
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19 


.536 
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Discussion 



c. 



This case corresponds to Case No. 1 of reference 
1. The only change was to replace the last three components 
each with three components in parallel with a subsystem 
reliability equivalent to the reliability of the replaced 
component. 



4 . Cases Fourteen Through Twenty- one a nd Thirty T hroug h 
Thirty-thr ee 



a. Reliability Block Diagram 




• • • 







b. Test Parameters 



(1) Numbe r of Component Test s x Ni. 



Cases 


_Ni 




14 


20 


i=1 , 2 , . . . , 15 


15, 18, 30 


25 


i=1 ,2, . . .,25 


16,17,31 


50 


i = 1 , 2 ,25 


17,20, 32 


100 


i = 1 ,2, ,25 


21,33 


200 


i=1 ,2 , . . . ,25 
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(2) T rue System and C omponen t R elia bil ities , Rs 

and Ri^ 



Cases 


Rs 


_Ri_ 








'.995 


i = 1 , 2, . . . , 14 


1 4 


.79239 - 


.850 


i=1 5 


15, 16,17 


.88222 


.995 


i=1 ,2,. .. ,25 


18,19,20,211 
30, 31 , 32 , 33J 


.97530 


. 999 


i=1 ,2,. .. ,25 



c. Discussion 

These cases correspond to several cases from 
Ref. 1 with the exception of cases 21 and 33 of the present 
study. These were added when it was noted that a large 
number of runs with zero failures were being observed with 
as many as 100 tests on each component. Cases 30 through 33 
are identical with cases 18 through 21. They are identified 
as separate cases, since a slightly different procedure, as 
described in section III. A, was followed in their 
simulation. 
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♦ Cas es Tw enty-two Through Twenty-nine 



a. Reliability Block Diagram 



,_ | pi [ - [ 02 | - 



••• - 20 - 



KIlH 



22 



23 






25 



26 -I 



p[~ 2 7 [fiTh 
— P^TT-TIo 



lqtxh^ 



33 



34 J 



In logical series with 



35 j — | 36 | — |~3~7 | 38 | -j- [ 38~| ~, 



38 



£ 



39 






35 ] -"IT}{T2]- [43] -^ { 43 ~[ - 

,| i {Tr 



- 44 

+ 



+ 4- 



39 | - |~ 4 Q | 41 



39 



39 






39 | — 1 ~ 4~0 } — | 41 | — < 



In logical series with 




b. Test Parameters 



(1) Nu mber of Com po nent T es ts, Ni. 



Cases 


_Ni 




22,26 


20 


i=1 , 2 


23,27 


25 


i=1,2 


24,28 


50 


i=1 , 2 


25,29 


100 


i= 1 , 2 



,60 

,60 

,60 

,60 



24 



(2) T ru e System 

and Ri^ 

Ca ses 

22 

through 

29 

22 to- 25 
26 to 29 



c. Discussion 



and C omponent Relia bil ities . Rs 



Rs Ri 





.999 


i=1 ,2 ,26 




.886 


i=27, 28,. . . ,32 


(See 






below) 


.900 


i=33 , 34 


t 

.999 


i=35, 36, . ..,41 




. .990 


i=4 2, 43,44 




j 


i 

-J. 

II 

1 

P 

P 


.87306 


( . 995) - 


_i=45, 46, . . . ,60 




i 


-J. 

II 

H* 

1 

P 

P 


.83293 


(.990) - 


i=45, 46, ... ,60 



The second and third subassembly reliability 
diagrams above were drawn from the Lockheed Reliability 
Evaluation Plan for the^Trident Missile [Ref. 3]. 

In the second diagram, component 44 and both 
components 41 must operate successfully for system success. 
An additional feature of this design is the capability of 
obtaining successful functioning of component 44 by 
following a logical path through component 39 and continuing 
in a reverse direction to reach component 44 from the 
opposite side of the diagram, if necessary. This capability 
is illustrated with double arrows to indicate that the 
logical success path may be traced in either direction for 
that portion of the reliability diagram. Note also that 
identically numbered components are, in fact, separate 
components but identical in operation. Therefore, component 
test results for a particular component type are assumed to 
be equally applicable to all components of that type, 
regardless of the specific application. The reliability 
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equation for this portion of the diagram, as adapted from 
reference 3 r is as follows: 



R 



= M T T T L M [1 - ( 1 -- M ) (1 — L M ) ] 

SS 4 L 1 2 3 3 3 L v l' ' Z 7. 

+ (1-T )L L L T M [1 - (1-M ) (1-T M ) ]1 

1 1 2 3 3 3 L V 2 ' 21 /J J 

+ (1-M )ThMMTTLL [1- (1-r ) (1-L ) ] 

4 Cl 2 3 2 3 2 3 L i' ' 1 /J 

+ (1-M ) MMTTTLLL 

1 23123123 



(• i- 



+ (1-M ) MMTTTLLLl 

2 1312312 3J 



where T = R R R R 

1 35363738 

I 

T = R i R 

2 38 3 9 

T = R R R 

3 394041 

L = R R R R 

1 35 364243 

L = R R 

2 4 3 3 9 



M = R 

1 3 8 

M = R 

2 4 3 

M = R 

3 4 4 

M = R 

4 3 9 

L = T 

3 3 



(3.1) 



The third subassembly diagram illustrates 
another type of reliability problem in that the subassembly 
reliability is defined in Ref. 3 as follows: 

l R 

R = i= 45 i 
SS 
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Although these diagrams represent current 
systems, the reliability values chosen bear no intentional 
relation to actual values other than that acquired when 
choosing them on a criteria of reasonableness. Therefore 
the values used are not classified. 
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IV. RESULTS AND CON CLUSI ONS 



A. SIMULATION RESULTS 



The simulation output is listed in detail in Appendix 0 
for each run. Each case was simulated three times with 
different random number generator seed values to insure 
against the occurrance of non-representative singularities 
in the observed data. Each simulation is distinguished by a 
letter suffix, a, b, or c, to the case number in Appendix D. 
The starting seed used each time was the ending seed value 
from the previous run. This insured that each run would be 
independent [Ref. 5]. 

The demonstrated accuracy of the estimation procedure 
can be measured in terms of the difference between the 
100 (1-a) percentile of the simulation results, R’* 0 , and the 
true system reliability, Rs. This difference, labeled D in 
the output tables, is defined as follows: 

D = R*° - Rs (4.1) 

As mentioned in Section III. A, the absolute value of D 
should be small and reflect a conservative error. This 
desired conserva ti vism is satisfied so long as the sign of D 
is negative. Otherwise the lower confidence limit 
estimation procedure would yield overly-optomistic estimates 
and could not be a valid vehicle for the description of 
system reliability. The one instance where this condition 
was not satisfied occurred in Case 13c. However, the value 
of D was extremely small, represented less than one-half of 
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one percent error, and differed from the conservative 
results of the other runs by less than one percent. 

It should also be noted that the distributions of the 
estimates Ti, S, and r are discrete in nature and the values 
are determined by the number and arrangement of components 
and the number of component tests. Estimates based upon few 
failures will exhibit the most highly discrete sample 
distribution scheme. The effect of this discreteness will 
generally be to increase the observed error magnitude unless 
some form of continuity correction can be developed. 



B. ANALYSIS OF RESULTS 



1 . Ge neral Charac teri stics 



The simulation output for Cases One through Twelve 
was expanded to include the complete ordered arrays of 
estimated confidence limit values in order to establish the 
nature of the sample. Some properties were evident from 
inspection. The samples were unimodal and discrete, as 
expected. Discreteness was most pronounced in the higher 
valued estimates. The sample distribution appeared nearly 
symmetric and this supposition was checked by comparing the 
sample mean and median values and also by plotting 
complementary quantiles. The first test showed very close 
agreement throughout. The second test indicated that only 
minor left skewness exists in most cases. Skewness seemed 
more pronounced for higher values of system reliability, as 
might be expected might be suspected, since the distribution 
is bounded by an upper estimate value of 1.0. 

The shape of the distribution was further described 



28 



by examining the ratio of the interquartile range divided by 
the interdecile range and comparing it with the same ratio 
from the Normal distribution which is about 0.526. The 
observed values were generally on the order of 0.50 which is 
in good agreement considering the discrete nature of the 
sample distribution. Systems designed with high reliability 
coupled with insufficient testing, such as Cases 18 and 19, 
exhibited great variations in the ratio, from 0.2 to 1.0, 
due to the sparcity of different sample values occuring in 
the pronouncedly discrete sample distribution. 

Another useful measure of shape is the sample 
standard deviation. It is particularly helpful in 
quantifying the spread of the data in terms of the units of 
measure. The preceeding ratio, on the other hand, was 
independent of the units. The sample standard deviation, 
however, gives no indication of skewness nor the 
discreteness of the underlying distribution. The standard 
deviation i--3 most useful when these higher order effects are 
small. 



The ability to predict the standard deviation from 
the test pl^n an£ system design parameters would provide an 
additional measure of the system reliability. This concept 
evolves from a consideration of the 100 (1-a) percent lower 
confidence limit. Of itself, it tells us only that there is 
a (1-a) probability that the true system reliability is 
greater than a particular value. The standard deviation of 
the estimate of this confidence limit can provide a feel for 
how much the true system reliability might vary from the 
estimate. For example, given an eighty percent lower 
confidence limit of 0.78 and a predicted standard deviation 
of the estimate of 0.005, we can feel fairly certain that 
the true system reliability does not exceed 0.82. However, 
had the standard deviation been 0.01 or 0.02, there would be 
increasing uncertainty about the range of likely values of 
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true reliability. Therefore, the sample standard deviation 
has been included in the regression section later in this 
chapter in an effort to not only predict procedure accuracy, 
but also estimate spread. 



2 • Derivat ion and Dis cu ss ion of TT 



Previous tests of the original Log-Gamma procedure 
have indicated that the quantity 

k 

TT = l (Ni) (Qi) (4.2) 
i = 1 

could be used as an indicator of relative accuracy of the 
procedure, where Ni is the number of mission tests performed 
upon the i-th component and Qi is the design or expected 
unreliability goal for the i-th component [Ref. 1]. The 
quantity determined in this manner was the total amount of 
testing relative to the component unreliabilities, or, 
approximately, the expected number of test failures summed 
over all components and tests. 

A similiar measure was sought for the revised 
procedure examined in this paper. However, a simple 
expression, such as equation (4.2), could not be directly 
applied to the mixed series-parallel system. If the 
equation were used, it could lead to extremely large values 
of TT, since the parallel components would tend to dominate 
the sum. This is reasonable to expect, since the components 
connected in parallel, taken individually, would tend to 
have greater unreliability than the series components. 

The first revised equation proposed for TT can be 
used whenever all components within each parallel subsystem 
are given identical numbers of mission tests. 
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TT 



(4.3) 



K 1 K1 + K2 

= . I (Ni) (Qi) + . E ( N i * ) (Qi ' ) 

1=1 i=K 1+1 

where K1 is the number of series components in the system 

K2 is the number of series- parallel subassemblies 
connected in logical series in the system 
Ni, Qi are defined as above. 

Ni ' is the common number of tests given each component 
in the i-th subassembly. 

Qi' is the unreliability of the i-th subassembly 
computed from its component unreliability goals using 
standard series-parallel reliability computation techniques. 

Equation (4.3), in effect, reduces each subassembly 
to an equivalent •pseudo-component* connected in series in 
the system. The quantity TT is now approximately equal to 
the expected number of system-affecting failures summed over 
all components, subassemblies, and tests. However, the 
drawback of this equation is the necessity of testing all 
components within a subassembly an identical number of 
times. It would seem unnecessarily restrictive to conduct 
the same number of tests on a medium reliability component 
and on a high reliability component just to satisfy the 
equation . 

Therefore an alternate formulation for the term 
(Ni 1 ) (Qi') was sought which would provide a meaningful 
measure, and yet would allow unequal amounts of testing 
within subassemblies. The following ad hoc formulation is 
proposed : 

Each wholly series-connected branch within a 
subsystem will first be reduced to an equivalent single 
component by the following formula 

■Z (Ni) (1-Ri) 
ie B 

Nb (4.4) 

1 - Rb 
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where Rb is the classically determined branch reliability 

goal Rb = n Ri for series-connected components, 
ie b 

Ri is the reliability goal of the i-th component. 

B is the set of all components in the branch. 

Nb represents an "equivalent" number of branch tests 
(need not be integer) . 

The series-connected branch is replaced in the 
remaining computations by a single equivalent component with 
reliability goal Ri = Rb and number of mission tests Ni = 
Nb. 



After all wholly series-connected branches have been 
reduced in this manner, each wholly parallel-connected 
branch in the revised subassembly is reduced to an 
equivalent component in the following manner: 

Compute the equivalent reliability goal 

Rb = 1 - n (1-Ri) 
i e B 

in the usual manner. 



The number of possible combinations of individual 

test results for the branch components is n Ni, which is 

i«B 

set equal to the, same number of possible combinations 

obtained if each component had been tested Nb times. Thus 
the equivalent number of mission tests, Nb, is computed as 
the geometric mean of the component tests 



Nb = 



= f n Nil 
L ie B J 



1/m 



The above procedure is repeated until the entire 
subassembly is reduced to a single equivalent component, i'. 
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with its equivalent number of mission trials, Ni' , and 
equivalent unreliability goal, Qi* = 1-Ri*. tt may then be 
computed as before: 

K 1 K1+K2 

TT = Z (Hi) (Qi) + . Z (Hi*) (Qi') (4.3) 

1=1 1 = K 1+1 



3 . A ccuracy Pre di ction 



Appendix E contains the equations and methodology 
used to attempt to relate the accuracy measure, D, and the 
estimate standard deviation to the quantity TT. The 
principal conclusion to be drawn from the results is that 
accuracy is a predictable quantity only with respect to 
particular system configurations for which models have been 
generated and tested as in this paper. Accuracy seems an 
unstable variable from configuration to configuration, 
although it appears to be fairly well behaved within any one 
configuration. 

With respect to the estimate standard deviation, the 
value appears to be related more to the number of component 
tests than to the expected number of system affecting 
failures. Reduction in the magnitude of the standard 
deviation by about 0.01 appears to require alomst double the 
number of component tests. However, the magnitudes are 
generally less than 0.07 for component test sample sizes of 
20 or more. The standard deviation values also appear to be 
fairly insensitive to changes in system configuration. 

4 . Comparison with Earlier Resul ts. 

Cases 13 through 20 were taken from Ref. 1 in order 
to provide a basis for checking relative accuracy when 
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extending the Log-gamma procedure beyond simple series 
systems. Unfortunately, an apparent shortcoming of the 
original simulation makes the 1968 data suspect. 

The original results tended to be too optimistic for 
those cases, in particular, where the number of component 
tests was moderately low and the true component 
reliabilities were high. Significantly high estimates at 
the 100 (1-a) percentile were observed in the cases 
corresponding to Cases 13, 15, 18, 19, and 20 of the present 
study. Although, on this basis, the comparison is very 
favorable to the present procedure, it is thought that the 
original simulation results are in error with respect to the 
procedure. Reference 1 does not specifically identify the 
random number generator used, however some uniform random 
variate generators do not perform well for very small or 
very large numbers near the boundaries, such as would be 
encountered in the simulation procedure used in the original 
study. The present simulation binomial random variate 
generator was tested prior to use to insure proper 
performance throughout the range of simulation values used. 

Of the remaining cases (14, 16, and 17) the original 
results were much closer to the true system reliability in 
the first two cases and comparable in the last case. 
However, these results cannot be considered meaningful in 
light of the suspected problems with the random number 
generator. 



In addition, many instances of cases found in Ref. 1 
had prima-facia unreasonable results for the 100 (1-ot) 
percentile values, in that they were considerably higher 
than the upper bound imposed by the zero- failure, binomial 
system test treatment discussed in Appendix C. 

Another difference between the original study and 
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the present one is the use of an arbitrary continuity 
correction in the earlier procedure. This could also have 
been a contributor to the excess optimism in the reported 
simulation results. 

In light of the foregoing paragraphs, no comparison 
with the results of this study was deemed worthwhile. 



C. CONCLUSIONS 



The primary conclusion to be drawn from this study is 

that the Log-gamma lower confidence level procedure for 

series-parallel systems can be accurate. How accurate it 

will be in any specific application is a function of the 

# 

magnitude of the component testing program, the individual 
component reliabilities, and the complexity of the system. 
In addition, of course, the validity of the assumptions 
concerning component interaction and mission environment 
will also hear directly upon the accuracy of any procedure 
which purports to estimate system mission reliability from 
component test results. The effects of these assumptions, 
however will be controlled by the proper design of the 
component test procedures and are not addressed in this 
study. 

For the cases considered the Log-gamma procedure tends 
to be conservative, which is necessary if one takes the 
position that pleasant surprises with better than expected 
performance cost less than unpleasant surprises in the form 
of degraded demonstrated reliability. Of course, too much 
underestimation of system reliability could drive up the 
development costs in an unnecessary search for a much more 
reliable design. 
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The accuracy indicator TT developed in Section IV. B. 2 
can be used as a rough gauge of expected procedure accuracy. 
The following scheme is suggested for minimum values of TT 
for fairly good expected accuracy: 

Approximate 

Order of a = 0.20 a = 0.10 a = 0.05 

Accuracy 

0.02 6.1 12.8 19.2 

0.01 11.7 23.6 32.6 

However, since procedure accuracy ^ is so demonstrably 
sensitive to variation in the system configuration, the best 
approach prior to use of the Log-gamma procedure is to 
perform a simulation as described in Section III. A for the 
particular system design to be exercised. Such a simulation 
could be used to evaluate many different combinations of 
component test plans and also support the claimed accuracy 
of the lower confidence limit derived from the adopted test 
plan results. The investment in such a simulation effort 
should not be excessive from the standpoint of computer 
time, since the most complex cases examined in this study 
required less than five minutes of Central Processor Unit 
(CPU) time from start to end. Without the support of such a 
simulation specific to the system, the accuracy of the 
procedure can be predicted only very approximately. 

For extremely reliable systems, for which few failures 
are expected with large amounts of testing, the binomial 
lower confidence limit procedure developed in Appendix C 
might provide the desired magnitude of the lower confidence 
limit without the extra testing required to achieve the 
desired accuracy of the Log-gamma procedure. In fact, for 
cases of one failure or less, the binomial procedure is 
probably preferable on the basis of both theoretical rigor 
and ease of computation. 
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Finally, the matter of a continuity correction should be 
investigated. An appropriately determined continuity 
correction procedure could conceivably reduce the component 
testing requirements for the same expected procedure 
accuracy . 
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APPENDIX A 



DERIVATION OF UNBIASED ESTIMATE FOR Ti 



For 

Ti = Qi + Qi 2 /2 

an unbiased estimator is desired, based upon the component 
failure data. Let Fi be the number of failures observed in 
Ni mission tests on the i-th component. The expected value 

A 

of Fi is NiQi and an unbiased estimator, Qi, for Qi is 
Fi/Ni, where Fi is binomially distributed with parameters Qi 
and Ni; Qi = 1-Ri; and Ri is the true reliability of the 
i-th component. 

An estimator, Ti, for Ti will be chosen of the form 

fi = Ai[ Qi ] + Bi[ Qi 2 ]/2 (A.1) 

and the constants Ai and Bi chosen so as to make the 
estimator unbiased, that is the expected value of Ti is 
equal to Ti, 

E[Ti] = Ti = Qi + Qi 2 /2 (A. 2) 

= AiE[ Qi ] + (Bi/2) E( Qi 2 ] 

= (Ai/Ni) E[ Fi ] + (B/2Ni 2 ) E[ Fi 2 ] 

= (Ai/Ni) [ NiQi ] 

♦ (Bi/2Ni 2 ) [NiQi-NiQi 2 +Ni 2 Qi 2 ] 

= AiQi + B i Q i/ 2 N i - BiQi 2 /2Ni + BiQi 2 /2 

= [ Ai + Bi/2Ni]Qi + [Bi/2 - Bi/2Ni]Qi 2 (A. 3) 
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Equating equation (A. 3) term by term with equation (A. 2) 
yields the following two equations 

Ai + Bi/2Ni = 1 

and Bi - Bi/Ni = 1 

which reduce to expressions for the unbiased estimator 
constants: 





Ai = 


(2N i-3) / (2Ni-2) 


(A. 4) 


and 


Bi = 


Ni/(Ni-1) 


(A. 5) 
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APPENDIX B 



APPROXIMATION OP Var[ Ti ] BY Ti/Ni 



A. DERIVATION OF Var[Ti] 



The variance of Ti is derived as follows: 
From appendix A, 





Ti = AiQi + (BiQi 2 ) /2 


(B.1) 


thus. 


fi 2 = Ai 2 Qi 2 + AiBiQi 3 + (Bi 2 Qi 4 )/4 


(B.2) 




Var[ Ti ] = EfTi 2 ] - E 2 [ Ti ] 


(B.3) 



= E[ Ti 2 ] - Ti 2 



= (Ai 2 /Ni 2 ) E£Fi 2 ] + (AiBi/Ni 3 ) E[ Fi 3 ] 

+ (Bi 2 /4Ni 4 ) E[Fi 4 ] 

- [ Qi 2 +Qi 3 + (Qi 4 /4) ] (B . 4) 

Using the moment generating functions for the binomially 



distributed variable Fi, with parameters Qi and Ni, yields 

E[ Fi] = NiQi (3.5) 

E[ Fi 2 ] = NiQi + NiQi 2 (Ni-1) (B.6) 

E[ Fi 3 ] = NiQi + NiQi 2 (Ni-1) [ 3 + Qi (Ni-2) ] (3.7) 

E[ Fi 4 ] = NiQi 4 (Ni-1) (Ni-2) (Ni-3) + 7NiQi 2 (Ni-1) 

+ 6NiQi 3 (Ni-1) (Ni-2) + NiQi (B.3) 
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Substituting the moment equations (B.5) through (B.8) 
into equation (B.4) and simplifying the resulting expression 
yields the following equation for the variance of Ti: 



4Ni 2 -3Ni+ 1 3Ni- 4 

Var[Ti] = ■ - — — 7—7 Qi + : ■■ ■■ . — 7— Qi 2 



4Ni (Hi- 1) 2 
1 



2Ni (Ni- 1) 
2Ni-3 

Qi 3 — — Qi 4 



Ni- 1 2Ni (Ni- 1) 

or, in terms of Ai, Bi, Ni, and Qi: 

Bi 2 +2Ni 2 Bi (Ai+Bi) 2Ai+1 

Var[Ti] = — Qi + — Qi 2 



(B.9) 



4Ni 3 

Bi Ai 

- — Qi 3 Qi 4 

Ni Ni 



2Ni 



(B. 10) 



To test the approximation of Var[Ti] by Ti/Ni, equation 
(B.9) was solved with representative valures of Qi and Ni 
and compared with E[ Ti]/Ni. The percent error of the 
approximation was computed for each value and is given in 
table B-1. As expected, increasing Ni or decreasing Qi 
improves the accuracy of the approximation. 



By way of comparison, table B-2 shows the relative 
accuracy of this same approximation when Ti is defined as 
the first three, vice two, terms of the logarithmic series 
expansion of S [Eg. (2.3) ]. In this case the unbiased 
estimator for Ti will be 



Ti = Ai 1 Qi + Bi’ Qi 2 /2 + Ci'Qi 3 /3 (B. 11) 

where _ 6 (Ni- 1) (Ni-2) -3 (Ni-4) -2 

6 (Ni-1) (Ni-2) 

Ni (Ni-4) 

Bi' 

(Ni-1) (Ni-2) 

Ni 2 

Ci' = 

(Ni-1) (Ni-2) 
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Qi 


Ni = 10 


Ni = 50 


Ni = 100 


0.001 


-5.08% 


-1.10% 


-0.60% 


0.003 


-5.25% 


-1 .29% 


- 0.79% 


0.006 


-5.52% 


-1.58% 


-1.09% 


0.01 


-5.87% 


-1.96% 


-1.47% 


0.03 


-7.50% 


-3.73% 


-3.26% 


0.06 


-9.64% 


-6.07% 


-5.62% 


0.10 


-12.0% 


-8.65% 


-8.23% 


0.20 


-15.8% 


-12.9% 


-12.5% 


0.30 


-17.0% 


-14.4% 


-14.1% 


0.40 


-15.8% 


-13.4% 


-13.1% 


0.50 


-12.0% 


-9.67% 


-9.38% 


0.60 


-4.77% 


-2.40% 


-2.11% 


0.70 


+7.70% 


+10.3% 


+10.6% 



Table B-1 . grror Percentage of approximation 
for Var[Ti] Dsing Two-term Form of Ti. 



Qi 


Ni = 10 


0.001 


-0.06% 


0.003 


-0.17% 


0.006 


-0.33% 


0.01 


-0.56% 


0.03 


-1.68% 


0.06 


-3.36% 


0.10 


-5.57% 



i = 50 


Ni = 100 


-0.05% 


-0.05% 


-0.15% 


-0.15% 


-0.31% 


-0.30% 


-0.51% 


-0.51% 


-1.54% 


-1 .53% 


-3.09% 


-3.06% 



-5.11% -5.06% 

Table B-2. ..Error Percentage of approximation 
for Var[Ti] tJsing Three-term Form of Ti. 



Due to time constraints and the general acceptability of 
the values noted in table B-1, the use of the more complex 
definition of Ti was left for future study. However, figure 
B-1 plots the accuracy as a function of Qi, Ni, and form of 
Ti. 
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8 % 




Figure B-1. PERCENTAGE ERROR OF APPROXIMATION FOR V AR[ Ti ] 
VS. COMPONENT UNRELIABILITY. 
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APPENDIX C 



SPECIAL CONSIDERATIONS WHEN S EQUALS ZERO 



When all components have completed the course of mission 
tests and no failures have been observed along some 
reliability path through the system, the estimator § will 
equal zero. This, in turn, will result in the log-gamma 
lower confidence limit estimate being equal to one unless 
the procedure is modified to include some "virtual" or 
"pseudo" test failure value for the computations when this 
occurs. The alternative is to seek some other lower 
confidence limit procedure which applies with zero failures. 
Such an alternative is also suggested below. 



For simplicity, assume all series components and 
subassemblies have been subjected to an equal number of 
mission trials, N, without failure. This may be thought of 
as equivalent to conducting N mission trials on the system 
without failure, subject to the usual assumptions concerning 
test environment and component interaction effects. When 
unequal numbers of component trials are involved, the 
conservative course of action is to choose N equal to the 
smallest of the component trial values. 



Now the number of system mission trial successes, W, can 
be related to system mission reliability, Rs, by the 
binomial distribution formula 



& (j) <ES) ° 




Prob(# successes > W) (C.1) 



44 



where N 



number of mission trials 



The 100(1-a)$ Lower Confidence Limit Estimate for system 
reliability would then be the solution for R* in the 
following formula: 




<R*) (1 




(C.2) 



which, when W = N, reduces to 



N 

(R*) = a or R* 



1/N 
( “ ) 



This result may then be substituted into the Log-gamma 
procedure formula for R*< a> and solved for the number of 
equivalent component failures which would yield the same 
estimate of system reliability. 



R*(a> = exp 



I " ~[2r] S 1 = 

L 2r ], 1-ct J 



= ( a ) 



1/N 



where 



K * 

S = Z Ti 
i=1 



r = max 



. 0 , 



' K 
Z Ti 
i=1 



K Ti 
Z — 
i=1 Ni 




(C.3) 



which reduce to S = Ti and r = max[1,(Ni) (Ti) ], since only 
one component or subassembly will make a non-zero 
contribution to the sums. 

Now, if r = 1.0, then (Ni) (Ti) < 1.0 and Ti < 1/Ni. 

Also recall that 



where 



Ti 



Ai 



(Ai) (Qi) + (Bi/2) (Qi 2 ) 

2Ni - 3 . Ni 

— — — — , B i — , 

2 (Ni- 1) Ni - 1 



Qi = 



Fi 

Ni 



(2.5) 
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Or, equivalently. 



(Bi/2Ni 2 ) (Fi 2 ) + (Ai/Ni) (Fi) - Ti = 0 (C.4) 

Substituting for Ai, Bi and the earlier inequality for Ti, 



Ni 



L2 (Ni— 1 ) (Ni 2 ) 
which reduces to 



(Fi 2 ) + 



2N i-3 



2 (Ni- 1 ) (Hi) 



1 

(Fi) - — <0 
Ni 



Fi 2 + (2Ni-3) Fi - 2 (Ni- 1 ) < 0 
which, in turn, can be factored as 



(Fi - 1) [Fi + 2 (Ni-1) ] < 0 



(C.5) 



The only positive values for Fi which can satisfy this last 
equation are Fi less than or equal to one. This means that 
for any size Ni, the value of [2r] will be two. We can now 
solve the reliability estimate equation for Fi*, the number 
of equivalent failures for the Log-gamma method. 



f -[2r] S 
exp I 



= ( a ) 



1/N 



(C.6) 



S = 



V2 

/V2, 1-ot 
2H 



Ai (Fi*) Bi (Fi*) 2 
(In a) = + — (C.7) 



N 



2N 2 



which reduces to 

Fi* 2 + ( 2N-3) Fi* + (N 



-1) (In a ) [}( 2,1-a = 0 (C. 



8 ) 



This quadratic may be solved for Fi* as a function of N 
and a. The results are listed in table C-1. From the 
table, choosing Fi* at the N = 10 level will be conservative 
for all N greater than 10, yet will yield relatively 
accurate results for all larger N due to the slow rate of 
change of Fi* with respect to N. 
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N 


a=0 . 2 


a=0 . 1 


a = . 05 


5 


0.3888 


0.2670 


0. 1713 


10 


0.3721 


0.2531 


0.1610 


20 


0.3652 


0. 2475 


0.1570 


100 


0.3603 


0. 2435 


0.1542 


1000 


0i 3593 


0.2427 


0.1536 



Table C-1. Solution for Fi* with 
Various N and a Values. 
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APPENDIX D 



TABULATED SIMULATION RESULTS 



The following pages contain two tables listing the 
principal simulation output data. The tables are presented 
concurrently for each case, one case per page. The cases 
are listed in alpha-numeric order. The following list of 
terms applies: 

Case: The case number as explained in Section III.B. The 

letter suffix distinguishes between different runs of 
the same case using different seeds for the binomial 
random variate generating function. 

KK: The total number of components in the system. 

TT: The accuracy indicator as discussed in seciton IV. B. 

TM: The modified accuracy indicator described in Appendix 

E. 

Rs: True system reliability. 

CL: Confidence Level, CL = 100 (1-a) . 

R*°: The 100 (1-a) percentile of the simulation estimates of 

the 100 (1-a ) % lower confidence limit for system 
reliability . 

D: The primary accuracy measure. As discussed in Section 

IV. A, D = U*° - Rs. 

Mean: The sample mean of the estimates. 

S.D.: The sample standard deviation of the estimates. 
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Null Runs: The number of runs which occured during the 
simulation for which S equalled zero. Refer to 
sections II. C and III. A and Appendix C for further 
elaboration . 
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03a 32 13.4 8.67 0.8756 80.0 0.8691 -0.0065 0.8425 0.0325 
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Table D-2. Additional Simulation Output (continued) 



04a 32 4.59 2.97 0.7998 80.0 0.7555 -0.0443 0.6962 0.0680 
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Table D-2. Additional Simulation Output (continued) 
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Table D-2. Additional Simulation Output (continued) 



07a 32 4.67 3.03 0.7917 80.0 0.7557 -0.0359 0.6850 0.0807 
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Table D-2. Additional Simulation Output (continued) 



08a 32 11.7 7.57 0.7917 80.0 0.7788 -0.0129 0.7368 0.0520 
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Table D-2. Additional Simulation Output (continued) 
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10a 32 6.59 4.27 0.7232 80.0 0.6889 -0.0343 0.6233 0.0758 
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Table D-2. Additional Simulation Output (continued) 
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Table D-2. Additional Simulation Output (continued) 



15a 25 3.12 2.09 0.8822 80.0 0.8236 -0.0586 0.7790 0.0535 
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Table D-2. Additional Simulation Output (continued) 



16a 25 6.25 4.18 0.8822 80.0 0.8699 -0.0123 0.8285 0.0457 
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Table D-2. Additional Simulation Output (continued) 
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18a 25 0.62 0.42 0.9753 80.0 0.8359 -0.1394 0.8305 0.0195 
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Table D-2. Additional Simulation Output (continued) 
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Table D-2. Additional Simulation Output (continued) 
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21a 25 5.00 3.34 0.9753 80.0 0.9711 -0.0042 0.9603 0.0158 
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Table D-2. Additional Simulation Output (continued) 



22a 60 2.70 1.62 0.8731 80.0 0.8262 -0.0469 0.7790 0.0679 
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Table D-2. Additional Simulation Output (continued) 



23a 60 3.37 2.02 0.8731 80.0 0.8410 -0.0321 0.7942 0.0570 
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Table D-2. Additional Simulation Output (continued) 



24a 60 6.75 4.04 0.8731 80.0 0.8640 -0.0091 0.8260 0.0442 
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Table D-2. Additional Simulation Output (continued) 



25a 60 13.5 8.09 0.8731 80.0 0.8679 -0.0052 0.8411 0.0324 
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Table D-2. Additional Simulation Output (continued) 



26a 60 3.58 2.14 0.8329 80.0 0.7999 -0.0330 0.7462 0.0671 
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Table, D-2. Additional Simulation Output (continued) 



27a 60 4.47 2.68 0.8329 80.0 0.8104 -0.0226 0.7572 0.0615 
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Table D-2. Additional Simulation Output (continued) 
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Table D-2. Additional Simulation Output (continued) 



29a 60 17.9 10.7 0.8329 80.0 0.8269 -0.0060 0.8002 0.0326 



u 





















a 


omo 


c-ino 


CN;3-vO 




















s 


oon 


roor- 






















a 


cnoooo 


vovor- 


oooom 


O 


O 


O 


ZT 


rn 


ZT 


00 


00 




Ifl.H 


ooovo 


00 VO ^ 


or* in 


CN 


CN 


rn 


CN 


ZT 


ZT 




ZT 




a; x 


cnoooo 


000000 


000000 


oo 


oo 


rn 


no 


rn 


oo 


m 


rn 




0 <d 








o 


o 


o 


o 


o 


o 


o 


o 




HE 








• 


• 


• 


• 


• 


• 


• 


• 




(d 








o 


o 


o 


o 


o 


o 


o 


o 




> 


CNOCN 


00*— zt 


*-00c* 




















vz 


c-r-cN 


^or* 


oovoo 




















Q) 


ocno 


moo po 


OOCNOO 




















Ho 




C-CNO 


cr (no 


T— 


l n 


CN 


r— 


in 


VO 


in 


o 




•Hcr» 


00 00 00 


00 GO 00 


00 00 00 


o 


o 


O 


O 


o 


T“ 


o 


o 




-p 








r* 


in 


O 


r- 


in 


o 


00 


VO 




a 








r- 


r* 


00 


r* 


r- 


00 


r* 


r- 




Q) 








• 


• 


• 


• 


• 


• 


• 


• 




0 


CO VOO 


OOO 


r*in^ 


o 


o 


o 


o 


o 


o 


o 


o 


• 


pfe* 


enr-cj 


oom<- 


OCN00 




















<]) 


ooo 


c-ooc 




















'TO 


cmn 


CNO00 


(NO 00 


CN OOO 


















a> 


r* 


oooor* 


oooor* 


oooor* 




















<D 










o 


T— 


O 


CN 


o 


m 


rn 


c; 


-p 








oo 


T— 


ZT 


o 


cn 


no 


o 


r* 


•H 


<d 








T— 


CN 


O 


o 


T— 


o 




T— 


-P 


a a 


CNCCN 


rocNoo 


uooocN 


o 


O 


O 


o 


o 


o 


o 


o 


a 


•H cd 


mino 


CN OOO 


in oo vn 


















o 


-P-H 


T-O^— 


ocno 


CN r-T— 


o 


O 


o 


o 


o 


o 


o 


o 


u 


l/)nO 


OOOVO 


or- in 


O00VD 


1 


1 


1 


l 


1 


I 


1 


r 


w 


W CD 


oor*r- 


oor-r- 


oor-r* 




















S 
























w 


*P 
























-p 


•H 








00 


T— 


00 


o 




O 


r* 


vO 


rH 


a 


r-invo 


oo cun 


oo ^ 


O 


T— 


00 


rn 


rn 


o 


CN 


in 


3 


•HfeO 


f-00CN 


Ozrr- 


ooca-r* 


T“ 


r- 


CN 


CN 




CN 


CN 


v 


w 


P) 


t—oo 


00 VOVO 


oor-r* 


00 


00 


00 


00 


00 


00 


00 


00 


a> 


in 


oomcr 


rmm 


r-moo 


• 


• 


• 


• 


• 


• 


• 


• 


« 


o;cn 


r-r-r* 


r-r-r- 


r-r*r* 


o 


o 


o 


o 


o 


o 


o 


o 




u 
























c 


c 
























o 


a; 
























*H 


TO 


om*~ 


vDOOt- 


(NVOO 


o 


o 


o 


o 


o 


o 


o 


o 


«P 




r-cNin 


cNinoo 


^-crr- 


















aO 


MH 


cnoooo 


r-inin 


00 VO VO 


o 


in 


o 


o 


in 


o 


o 


in 


rH 


CO 


moo*- 


inoo*- 


mroT— 


o 


O 


00 


O 


cn 


00 


O 


O 


3 


o*- 


r-r-r- 


r-r^r- 


r-r-r* 


















a 


U 


• • • 


• • • 


• • • 


















•H 


























in 


u 


























Q) B 


pr)00vO 


or-cN 


VOOO^- 






O 






o 








* C 


oocNr- 


vom^- 


r*r*cN 






CN 






CN 






• 


o a 


or*r* 


CN Or- 


t— cno 






rn 






rn 








iH-H 


r*moo 


r-moo 


or*vo 






00 






00 






1 


c 


vOVOVO 


VOVOvO 


r-vovo 






• 






• 






Q 


•H 












o 






o 






<1> 


E 
























i— ♦ 


























XI 


t-H 


oom 


oom 


oom 






r* 






r* 






cd 


CJ 


oooo 


ooocn 


oo oo 






• 






• 






EH 














o 






o 


































rH W 

rH C 












o 






O 








C C 












• 






• 








25CEJ 


o 


o 


o 






r- 






r* 




















r— 
















rn 


00 


oo 






















cn 


o 


o 






O 






o 








W 


CN 


CN 


CN 






VO 






VO 








« 


oo 


on 


00 






















00 


00 


00 






















• 


• 


• 






















o 


o 


o 






XI 






o 








CD 












O 






o 


















CN 






CN 








w 


cd 


X 


u 


















<d 


cn 


<T> 


o 




















U 


CN 


CN 


CN 



78 



Table D-2. Additional Simulation Output (continued) 
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Table D-2. Additional Simulation Output (continued) 



33a 25 5.00 3.34 0.9753 80.0 0.9711 -0.0042 0.9605 0.0160 
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Table D-2. Additional Simulation Output (concluded) 



APPENDIX E 



REGRESSION OF OBSERVED ACCURACY 



Examination of the tabulated data in Appendix D suggests 
that a linear relationship is not directly applicable to 
regression of the accuracy measure, d, on any of the other 
variables. The terms IT, developed in section IV. B. 2, and 
KK, the number of components, appear to be the most likely 
candidate independent variables for the model. Plots of 
these terms versus D suggest that an exponential decreasing 
or inverse power curve could be used to model procedure 
accuracy on TT, i.e. 

D = a»exp(b«TT) (E.1) 
b 

D = a»TT (S . 2) 

where a and b are appropriate constants from the underlying 
response function. Each of these models can be easily 
transformed into a linear model by taking the natural 
logarithm and redefining variables and coefficients where 
convenient. 

The plots indicate, however, that the system 
configuration has a strong effect. Therefore, curve fitting 
will be initially confined to similar configurations in the 
following groups: Cases 01 to 12, Cases 14 to 17, and Cases 
22 to 29. Cases 1 8 to 21 will be considered only with 
reservations due to the artificial bias introduced by the 
particular procedure used which ignored failureless runs. 
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Cases 30 to 33 will not be fitted since the procedure 
employed caused the sample to be drawn from two quite unlike 
distributions and the plots demonstrated an apparent 
discontinuity between the results of the two methods (see 
Section II. C and Appendix C) . Finally, if the group fits 
are good, a composite fit will be attempted for Cases 01 to 
17 and 22 to 29. This fit would not be expected to be good 
due to the observed inter-group plot variation. 



A. EXPONENTIAL CURVE FIT 



Consider the linearized exponential model 
D * = A + b«TT 



(E.3) 



where D' = In (-D) and A = In (-a) . From the Method of Least 
Squares, expressions for A and b can be derived directly. 



b = 



n 1 r n -I I- n •» 

I TT D 1 - — I X TT jj X D I 
i=1 i i n L i = 1 i J *-i=1 i J 

n 1 r n i 2 

E TT 2 - -I E TT 1 
i= 1 i n »-i = 1 iJ 



1 r n i b r n t 
A = -I X D’ | - -I X TT | 
n*-i= 1 iJ n >-i= i iJ 

and the coefficient of determination [Ref. 6 ] is 



1 


f E TT D' - — j 

[ i=1 i i nl 


r n 
L±£ 




]’ 


n 1 r n 1 

X TT 2 - - X TT 
i= 1 i n L i=1 V 


l ! ] 


[i Ii D i* - 


J, D i] 2 ] 



The results of the exponential curve fit were as 
follows: 
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Cases 


a 


a 


b 


r£_ 


01-12 


.20 


-0.040 


-0.065 


0.690 




.10 


-0.094 


-0.076 


0.724 




.05 


-0.073 


-0.048 


0.738 


14-17 


.20 


-0.118 


-0.290 


0.942 




.10 


-0.301 


-0.282 


0.938 




.05 


-0.480 


-0.260 


0.988 


22-29 


.20 


-0.049 


-0. 156 


0.896 




.10 


-0. 153 


-0. 170 


0.899 




.05 


-0.346 


-0.216 


0.917 



3. INVEHSE POWER CURVE FIT 






The power curve may be linearized to the form 


D' = A 


+ b*TT f 




(E.3) 


where A and D* 


are defined as before and TT' = In (TT) . The 


coefficients, A 


and b, and the coefficient 


of determination 


may be found as 


: described in the 


preceding 


section with the 


substitution of 


TT' for TT where 


occuring . 




The results 


of the power curve fit were 


as follows: 


Cases 


a a 


b 


r£_ 


01-12 


.20 -0.130 


-0. 868 


0.844 




.10 -0.368 


-1.016 


0.883 




.05 -0.780 


-1. 124 


0.893 


14-17 


.20 -0.664 


-2.085 


0.986 




.10 -1.589 


-2.016 


0.972 




.05 -2.110 


-1.828 


0.992 


22-29 


.20 -0.159 


-1.305 


0.989 




.10 -0.543 


-1.412 


0.977 




.05 -1.041 


-1 . 430 


0.980 


01-17 


.20 -0.136 


-1 . 060 


0.648 


22-29 


.10 -0.459 


-1.228 


0.793 




.05 -0.936 


-1.303 


0.845 



Comparing these results with those of the exponential 
curve fit indicates that the power curve provides a better 
fit for the observed simulation data. However, the 
variation in the coefficients between different system 
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configurations implies that, while the fit may be good 
within like groups, the fit is much more approximate across 
the groups. This is borne out by the composite fit listed 
last in the preceding table. 



C. REGRESSION OF D ON TT AND KK 



For this regression the model chosen was a combined 
power curve 

b c 

D = a«TT KK (E.5) 

which linearizes to 

D' = A + b«TT' + c*KK' (E.6) 

where D', A, and TT' are defined as before and KK' = In (KK) . 

Solving for the coefficient values by the Method of 
Least Squares yields the following: 



r S 1 «S2 



L n 



1 r s ^ 3 t r; 

j S6 1 | S8 | - j - S7j| S4] 

jlq jlq Ji-n J 



-S2* S3 



pS 1 2 



c = 



pS 1 2 i pS3 2 -i r S1 *S3 ■, 2 

I S 4 j I S5j - I S8 1 

c n J l n J l n ■* 



S 1 • S 2 



b = 



t pS 1 • S3 

S 6 1 - c | S8 | 

j l n J 



i • 

n 



SI 2 



n 



- S4 



where 





r 1 


b 


c i 




a 


= exp| — S2 - 
•»n 


-SI - 
n 


-S3 
n J 






n 




n 


n 


SI 


n 

h3 

Hi 


S2 


= E D ' 


^0 

U) 

ii 




i=1 i 




i=1 i 


i= 1 




n 




n 


n 


S4 


_ j IJI2 


S5 


= E KK' 2 


S6 = E 




i=1 i 




i= 1 i 


i = 1 
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S 7 



= Z Fd'*kk'1 
i=1 l i i-« 

From the data for cases 
the following values for a, 

a = 0.20 a = -0.080 

a = 0. 10 a = -0.386 

a = 0.05 a = -1.038 



and S8 = ? [tT • •KK'l 

i= 1 i iJ 

01 through 17 and 22 through 29, 
b, and c were obtained: 



b = -1. 028 


c = 


0 .129 


b = -1.200 


c = 


0.033 


b = -1.279 


c = 


-0.043 



An approximate coefficient of determination was 
calculated by defining 

c/b 

TM = TT* KK 

so that 



b 

D = a*TM 

which is the inverse power curve model and the two variable 
procedure of Section B can be used. This yielded an r 2 
value of 0.626 for a - 0.2, which shows no improvement of 
fit for the three variable approach. 



Appendix D lists TM values for a = 0.2 for information. 



D. REGRESSION OF STANDARD DEVIATION 



Examination of the sample standard deviation values 
listed in Appendix D also suggests that the power curve form 
would be appropriate to model the standard deviation on TT. 

b 

S.D. = a*TT 

Proceeding as in Section B, the following values are 
obtained : 
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a = 


0. 20 


a = 0.094 


b = -0.300 


r 2 


= 0.523 


a = 


0. 10 


a = 0.075 


b = -0.219 


r 2 


= 0.374 


a = 


0.05 


a = 0.072 


b = -0.215 


r 2 


= 0.408 



which indicates a poor fit at best. 

However, the data suggests that the sample standard 
deviation may be better predicted as a function of the 
number of component tests, i.e. 

b 

S.D. = a«N 

where N represents the "equivalent” number of system tests 
as derived in Section 17. B. 2 for use in Equation (4.3) . 



The regression yields the following values: 



a = 


0.20 


a 


= 0.213 


b = -0.391 


r 2 = 0.853 


a = 


0. 10 


a 


= 0.186 


b = -0.365 


r 2 = 0.825 


a - 


0. 05 


a 


= 0. 164 


b = -0.339 


r 2 = 0.799 



This fit is better and implies that the primary mechanism to 
reduce the sample standard deviation is to increase the 
number of component tests. As the data base is limited, 
little more than that may be averred at this level of 
analysis . 
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APPENDIX F 



COMPUTER PROGRAM 



The following pages contain a representative listing of 
the main computer program utilized in the simulation. Three 
proprietary routines were used for binomial random variate 
generation (GGBIN) , inverse Chi-Sguare value determination 
(MDCHI ) , and ordering of the estimate arrays (VSORTA) . 
Reference 4 provides information concerning the contents and 
use of these routines. Equivalent routines could be used 
without penalty to either accyracy or consistence of the 
simulation results. 

The program was written in the FORTRAN 17 language for 
use on the IBM-360 computer system installed at the Naval 
Postgraduate School. 

Portions of the program must be changed as the 
subassembly configurations are varied in order to tailor the 
computations to the specific system being modeled. 
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